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Abstract 

We consider the problem of distributed average consensus in a sensor network where sensors exchange quantized 
£N) ' information with their neighbors. We propose a novel quantization scheme that exploits the increasing correlation 

between the values exchanged by the sensors throughout the iterations of the consensus algorithm. A low complexity, 
uniform quantizer is implemented in each sensor, and refined quantization is achieved by progressively reducing 
the quantization intervals during the convergence of the consensus algorithm. We propose a recurrence relation 
for computing the quantization parameters that depend on the network topology and the communication rate. We 
further show that the recurrence relation can lead to a simple exponential model for the size of the quantization 
step size over the iterations, whose parameters can be computed a priori. Finally, simulation results demonstrate the 
7— I , effectiveness of the progressive quantization scheme that leads to the consensus solution even at low communication 

CN ■ rate. 

■ Index Terms 

Q \ Distributed average consensus, sensor networks, progressive quantization. 

I. Introduction 

■ Distributed consensus algorithms [fl] have attracted a lot of research interest due to their applications in wireless 
network systems. They are mainly used in ad-hoc sensor networks in order to compute the global average of 
sensor data in a distributed fashion, using only local inter-sensor communication. Some of their most important 

q ' applications include distributed coordination and synchronization in multi-agent systems Q, distributed estimation 
t-h ■ 0, distributed classification [4| and distributed control problems. 

I/-) \ While in theory convergence to the global average is mostly dependent on the sensor network topology, the 
performance of distributed average consensus algorithms in practical systems is largely connected to the power or 

^~~] . communication constraints and limited precision operations. In general, the information exchanged by the network 
nodes has to be quantized prior to transmission due to limited communication bandwidth and limited computational 

• i-H ■ power. However, this quantization process induces some quantization noise that is accumulated throughout the 

^ iterative consensus algorithm and affects its convergence, leading to significant performance degradation |0. 

In this paper, we design a novel distributed progressive quantization algorithm that limits the quantization noise 
and leads to convergence to the average value even at low bit rates. Motivated by the observation that the correlation 
between the values communicated by the nodes increases along the consensus iterations, we build on our previous 
work |6l and propose to progressively and consistently reduce the range of the quantizer in order to refine the 
information exchanged in the network and guide the sensors to converge to the average consensus value. The 
proposed quantization scheme is computationally simple and consistent throughout the iterations as every node 
implements the same quantization all the time. We describe a method for computing offline the parameters of the 
quantizers, which depend on the network topology and the communication constraints. Our design is based on 
an average case analysis, which leads to effective performance in realistic settings. Convergence of the consensus 
iterations is achieved when the energy of the quantization error decreases with the iterations. We illustrate the 
performance of the proposed scheme through simulations that demonstrate that the consensus algorithm converges 
fast to the average value even in the case where the information is hardly quantized. 

A few works have been proposed recently to address the problem of quantization in consensus averaging 
algorithms. In particular, it was shown in J5) that if the quantization noise is modeled as white and additive 
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with fixed variance then consensus cannot be achieved. The authors in Q propose a probabilistic quantization 
scheme that is shown to reach a consensus almost surely to a random variable whose expected value is equal to the 
desired average. Unfortunately, the scheme performs poorly at low bit rate. Kashyap et al. (8j designed an average 
consensus algorithm with the additional constraint that the states of the agents are integers. Thus convergence is 
achieved to some integer approximation of the average of the initial states. Modifications of the classical consensus 
algorithm have been proposed in ||9), iTTOl , including a compensation error term that guarantees that the average is 
preserved at each iteration. A coding scheme based on predictive coding is proposed in ifTTI in order to exploit the 
temporal correlation among successive iterations. Convergence to the true average is shown to be possible under 
the condition that the quantization noise variance vanishes over the iterations. A different approach for dealing 
with the quantization noise and additive white noise in general is proposed in lTT2l and |[T3l respectively. Both 
algorithms adapt the weight link sequence in order to guarantee convergence under certain conditions, at a cost of 
lower convergence rate. In general, all the above mentioned algorithms either maintain the average value in the 
network but cannot reach a consensus effectively, or converge to a random variable that is not always the target 
average value. 

More recently, the authors in lTT4l . lTT5l and |[T6l have proposed quantization strategies that maintain the average 
of the initial state and at the same time converge asymptotically to the true average value. The quantization scheme 
introduced in lPT4l adaptively adjusts the quantization step-size by learning from previous states, at the price of 
significant complexity and memory requirements. The quantization threshold in |[T5l is adapted online based on a 
zoom-in zoom-out strategy, while the set of quantization levels is maintained constant over the iterations. Although 
these last two solutions perform quite well at high bit rates, the convergence rate appears to be slow when the 
quantization is coarse. In addition, the stability of both quantization schemes depends on the choice of globally 
defined parameters that are not easy to determine a priori. Finally, the scheme proposed in lTl6l is the one that is 
closer to our work since it is based on the assumption that, as consensus is achieved asymptotically the prediction 
error of the sensors' states tends to zero. The scaling function is selected in such a way that it decays over time 
without causing the saturation of the quantizer. However, the proposed scheme leads to very conservative selection of 
the parameters of the scaling function that prevents reading significant gains in the average consensus performance. 
On the other hand, our system is able to achieve fast convergence to the true average value in realistic settings, 
even if it does not provide strict performance guarantees; it relies on average case analysis instead of conservative 
bounds. 

The structure of the paper is as follows. Section |TT] presents our new progressive quantization algorithm. A 
recursive method for computing the quantization parameters is proposed in Section Jill followed by a simple 
exponential relation for adapting the quantizer step-size. Simulations results are finally presented in Section [TV] 

II. Progressive quantizer for distributed average consensus 

We consider a sensor network topology that is modeled as a weighted, undirected graph Q = (V, £), where 
V £ {1, . . . , m} represents the sensor nodes and m = \V\ denotes the number of nodes. An edge denoted by an 
unordered pair {i,j} £ £, represents a link between two sensor nodes i and j that communicate with each other. 
Moreover, a positive weight W(i,j) > is assigned to each edge if {i,j} £ £■ The set of neighbors for node i is 
finally denoted as M-i = {j\{i,j} £ £}■ 

The node states over the network at time t can be expressed as a vector z t = [^(1), ... , zt(m)] T , where Zt(i) 
represents a real scalar assigned to node i at time t. The distributed average consensus problem consists in computing 
iteratively at every node the average fi = — YlT=o z o(^)> where Zo(i) is the initial state at sensor i. The consensus 
can be achieved by linear iterations of the form Zt+i = Wz t , where the symmetric weight matrix W satisfies the 
conditions that are required to achieve asymptotic average consensus ifrTI . expressed as 

1 T W = 1 T , Wl = 1, p{W - ll T /m) < 1, (1) 

with p(-) the spectral radius of the matrix and 1 is the vector of ones. 

When communication rate is limited between sensors, the value zt(i) of a sensor node i at each step t is quantized 
prior to its transmission to neighbor nodes. The quantized value z t (i) can be written as 



z t {i) = z t (i) + e t (i), 



(2) 



3 



where et(i) models the additive quantization noise of sensor i at iteration t. In particular, in the case of a n-bit 



uniform quantizer, the quantized values can be written as zt{i) 



sensor states lie in a finite interval of size S 



(max) (min) 



• A + f + z 



(min) 



, when the initial 



'0 



"0 



. The parameters Zq" 1111 ^ and z^ 1 ^ represent the 



minimum and the maximum values of the interval respectively. The parameter A = S/2 n is the quantization 
step-size, which drives the error of the quantizer. 

In the presence of quantization noise in the distributed average consensus algorithm, we use the following linear 
iterations that preserve the average of the initial states [@ 



z t +i = z t + (W - I)z t , 



(3) 



where I is the identity matrix. An analytical expression of Eq.© shows that the quantization error propagates 
through the iterations of the consensus algorithm. More specifically, the states zt+i and z t are expressed as 



t-i 



(4) 



s=0 



Zt+l 



W t+1 Zo + J2w s {W-I)e t - s . (5) 



The linear iterations defined by Eq.© preserve the average of the initial states in the network but unfortunately 
do not guarantee convergence to the average consensus value in the presence of quantization. In order to limit the 
influence of the quantization noise, we should decrease the step size by either increasing the number of bits or 
adapting the quantization range for the same number of bits. In the average consensus problem, it can be observed 
that as the number of iterations increases, the correlation between the sensors' states increases and the values 
computed by the sensors tend to converge into an interval of decreasing size. Quantization in the full range of 
size S hence results in a waste of bits or in limited precision that prevents the algorithm to converge to the true 
average value. We therefore propose to adapt the quantization step-size as the number of linear iterations increases 
in a new progressive quantization algorithm. We keep a simple uniform quantizer with a fixed number of bits per 
sensor and we adapt the quantization range so that quantization becomes finer along the iterations. 

In more details, we denote the size of the range of the quantizer in node i at time t as St(i). Since the size of the 
quantization range is always positive, we impose St(i) > 0. This range decreases in each sensor as the iterations 
proceed. The quantization range is further centered around the previous state of the consensus algorithm Zt-\{i) 
as the values of the consensus algorithm converge over time. More formally, the sensor i encodes its state zt+i(i) 
by using a quantization interval that is defined as [z t (i) — St+\(i)/2, St (i) + St+i(i)/2]. The data is uniformly 
quantized in this reduced range, which leads to a step-size 

Am = %^ (6) 

that decreases over time. The values falling out of the quantization interval are clipped and coded to the nearest 
quantizer value. In order to simplify the design of the quantizer for realistic settings, we impose the size of this 
interval to be identical for all the sensors, independently of their previous state and their position in the network 
(i.e., St(i) = St, Vi = 1, . . . , m). Since each neighbor node j £ Mi knows the value zt(i) received at the previous 
iteration, it is able to perform inverse quantization and to compute correctly the value zt+i(i). We call the proposed 
quantization scheme Progressive Quantizer. 

The important parameter in the Progressive Quantizer algorithm is clearly the size St of the quantization range. It 
has to be small enough such that the precision of the quantized information is sufficient for convergence to the true 
average value. On the other hand, it should be chosen large enough such that the values computed in the network 
nodes fall in the quantization range with high probability in order to avoid clipping that may negatively affect the 
convergence of the average consensus algorithm. 
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III. Design of the parameters of the progressive quantizer 
A. Average case analysis 

In this section, we propose a constructive methodology to compute a priori the size of the quantization range, 
based on the properties of the network topology and the communication constraints. In order to guarantee that the 
quantizer does not saturate (i.e., all the values fall inside the quantization range), St+i should satisfy the following 
inequality 

II » II ^ en\ 

- Zt||oo < — y~ ■ ( 7 ) 

The computation of the worst case interval based on © typically leads to conservative progressive quantizer design 
that does not necessarily lead to to a better performance than the classical uniform quantizer with a constant range. 
This observations is supported by simulations in subsection IIV-CI where a conservative design |[T6l is unable to 
lead to fast convergence. Instead of looking for strong guarantees such as those in (0, we build our quantizer such 
that values fall in the quantization range with high probability. This comes at a price of some potential clipping, 
which however does not significantly penalize the convergence of the algorithm. Moreover, limiting a priori the 
dynamic range of the sensors' states in a meaningful way is expected to prevent the consensus algorithm from being 
affected by potential outliers that occur due to quantization noise. The overall procedure could be characterized as 
an attempt to guide the quantized consensus algorithm such that it converges to the average value with a rate that 
gets close to the convergence rate of the ideal unquantized consensus algorithm. 

In more details, we propose to relate the quantizer range size to the mean square difference \\zt+i — zt\\ 2 /m 
between two successive values. It leads to the following average case condition 

^h±i - ^ < ( w (8) 

m 2 

where || • || denotes the L2 norm. The expectation of the difference between successive values in the consensus 
algorithm represents the minimal size of the quantization range at each iteration. Moreover, we model the quanti- 
zation noise samples as spatially and temporally independent random variables that are uniformly distributed with 
zero mean and variance Af/12. In the sequel, we first derive in Proposition Q] an upper-bound of — zt\\ 2 ] 

that depends on the previous values {S±, ...,St}. This upper-bound together with d8j permits to estimate St+i. 

Proposition 1. Let zt and Zt+i be defined as in Eqs. (0), (0). Let also A2 be defined as A2 ■= p{W — and 
A m i n be the smallest algebraically eigenvalue of W. Then, it holds that 

t-x 



E[\\z t+ i - Stf] < ||*o|W(l - A min ) 2 + (1 - A min ) 2 V \\W S (W - I)fm S ' 



S 2 

(2-X min ) 2 m- 



s=o (9) 



2 2n ■ 12 ' 

The proof of Proposition Q] is given in Appendix lAl 

Then, Eqs. © and (|9]) along with the fact that ||-zo|| 2 < m||,Zo||ro> imply that 

(%i) 2 = INI^i - Amin) 2 + (1 - A min ) 2 £ \\w*(w - i)\\ 2 §rf 2 

s=0 " (10) 



+ (2-A min ) 2 -^, t>l. 



3. 

2' 2n ■ 12' 

The computation of the quantizer range size with (fTOl l implies a recursive computation of St at each time step t of 
the consensus algorithm. We first set So according to the initial range of the quantizer i.e., So = zj^ 8 ^ — Zq™ 111 ^ and 
we compute Si from a simplified version of (fTOl l where the intermediate term from the right hand side is dropped. 
Then St+i is computed recursively according to (fTOl . where only positive solutions are kept. 

Finally, we note that the terms used in the recursive computation of the quantization range reflect the characteristics 
of the network and the communication constraints. The values of the estimated quantization range depend on the 
convergence rate of the average consensus algorithm in the absence of quantization noise A2, on the maximum 
value of the initial data ||zo||<x» on the network topology W (through A2, A m i n ) and on the number of quantization 
bits n for each sensor. Moreover, we exploit the properties of the weight matrix W by taking into account the 
averaging effect over the successive iterations. We show in the next section that the recursive computation of the 
quantization range size can be approximated with a simple exponential model. 
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B. Exponential quantization range 

We build on the convergence behavior of the consensus algorithm and propose an approximate exponential model 
for the computation of the size of the quantization range. We first pose without loss of generality that St = 2 • e _/3t . 
In what follows, we show that under a few simplifying assumptions the recursive relation of the previous section 
leads to an exponential model whose parameters can be determined in closed form. This closed form parameter 
computation is of great benefit towards deployment in realistic settings. 

When S t = 2- e" ft , Eq.flO]) becomes 



i-l 

e- 2Pt+1 = IMM'a - A min ) 2 + (1 - A min ) 2 V \\W S (W ~I)\\? e 



-2ft 



/ j II V ) II r,2n o 

6=0 16 (11) 

e -2ft 

+ (2-A min ) 2 ^ r -^, t>l. 

The second term in the right-hand side of Eq.(fTTTl is due to the accumulated quantization error from the previous 
t iterations. In particular, the matrix norm ||M /t (VF — I)\\ that multiplies the quantization noise vectors decays 
asymptotically to zero. In addition to that, the sequence defined by Eq.tfTTT) decays to zero as specified by the 
following proposition. 

Proposition 2. Let e~P t+1 be a sequence defined by Eq.kTl\t. If the condition ^tjz^ + (2 — A m j n ) 2 < 3 • 2 2n is 
satisfied, then ]\m t _+ 00 e~^ t+1 = 0. 

The Proposition |2j whose proof is given in Appendix |B] relates the decay and convergence of the size of 
the quantizer range to the characteristics of the network (through A2 , A m i n ) and to the number of bits used in 
the quantization. Eventually, it means that the expected squared difference between consecutive values in the 
consensus algorithm as defined by the recursive equation ([TTI) goes to zero as long as the number of bits satisfies 

i°g[|( V^'f +t 2 -^-) 2 )] 

n > 2log2 ■ Then, the following proposition shows that the second term in the right-hand side 

of Eq.(fTn> becomes negligible when the number of iterations increases. 

Proposition 3. Let W be a matrix satisfying the conditions defined in (|7}. Let e~^° ,e~^ , ...,e~^ be a sequence 
such that < 5, Vi and lim^oo = 0. Then X]s=o ll^ s (^ — I)|| 2 e -2 ^ t_,_I converges asymptotically to 
zero for t — > 00. 

The proof or Proposition [3] is given in Appendix |Cl and it is based on the proof of Lemma 5.1 in |[T8l . 

Due to the presence of the factor l/2 2n , the second term of the right-hand side of Eq.dTTb decreases faster to 
zero when the quantization rate is high. This is expected, as this term captures the propagation of the quantization 
error. Eq. (fTTl tend to follow an exponential model in this case. We can thus pose fit = ol ■ t + 7, which leads to 
an exponential decay of the size of the quantization range. We assume that there exists an iteration to where the 
second term of the right-hand side of Eq. (fTTT i becomes zero. Under this assumption, Eq.tfTTTl simplifies to 



e" 2 ^ 1 = IMlLAifU- A min ) 2 + (2-A min ) 2 ^ r ^, t>t , (12) 
and by substituting (3 t = a • t + 7 we obtain 

e - 2 Mm )+7) = | NM(1 _ Amm) 2 + (2 _ Amin ) 2 e 22w - , t > t . (13) 

Since a and 7 are constant over the iterations, we choose to determine them from later iterations of the consensus 
(i.e., t > t ). First, we turn A 2 into an exponential form by determining a such that A 2 .* = e~ 2a4 holds. This leads 
to 

a = -log(A 2 ). (14) 

Eq. (fT2l then becomes 

e" 2 /W = ||, ||2 oe -^ (1 _ Amm)2 + (2 _ A 



-2ft 



2 2n • 3 

A 

2 2_ 
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Since j3 t is linear in t, we observe that e 2 ^ t+1 = e 2 ( a ( i + 1 )+7) = e 2a g 2/9^ w j 1 j c j 1 p erm its to simplify (fl"5T l to 



2 „2 7 /-| _ \ . \2 , ( 2 A min)' 
3 C ^± A mm j -i- 2 2^ • 3 



7 =ilog fA|- (2 o9 „ Am ^ )2 l 



We finally determine 7 as 

- 2 \" 2 2 2n ■ 3 

We observe that the decay rate a of the exponential function e~( a ' t+ ^ depends on A2, which characterizes the 
convergence rate of the average consensus algorithm in the case of non-quantized communication. On the other 
hand, the parameter 7, apart from the eigenvalues of W, depends also on the number of quantization bits. It is 
interesting to note that the parameters of the exponential model are similar to the parameters a', 7' that characterize 
the difference between two consecutive time steps in the unquantized consensus problem. In this case, the Euclidean 
difference between two consecutive time steps is guaranteed to be reduced by the factor \\W — 11 T /m\\ < 1 at 
each iteration i.e., 

||*+i-a*|| _ \\Wzt-Wzt-tW < WW-^WWzt-zt-4 



m \/m 

T 



<^=\\W-— 111*1 -zoll <-)=\\W-— W'WW - I\\\\zo\\ 
m \ m m 



11 T 



< w — nw-in Zo \u 

m 

where we observe an exponential decrease over time of the form e~( a ' ' t+7 '\ where a' = — log(||W — ^-||) and 
7' = — log (HlzolloolllVK — In particular, the rate at which the exponential function decays is the same in both 
cases (a' = a = — log(A2)) while, in the case of quantization, the initial value 7 of this decay depends on the 
number of bits (which is not the case for 7'). 

In summary, with our progressive quantizer based on the exponential decay of the quantization range, we force 
the average difference in the sensors' states between two consecutive steps to decay with the same rate as in the 
ideal communication. At the same time, we allow the initial magnitude of this difference to be higher for a smaller 
bit rate in order to take into consideration the quantization error. We emphasize that the above exponential model 
for St yet reduces the complexity of the proposed Progressive Quantizer. Instead of estimating a priori the values 
of the quantization range for a large number of iterations, the system can simply use the parameters a and 7 of 
the exponential model. 

IV. Simulation results 

In this section we analyze the performance of the Progressive Quantizer in different settings. We consider a 
network of 40 sensors (i.e., m = 40) following the random geographic graph model, i.e., the sensors are uniformly 
random distributed over the unit square [0, 1] x [0,1]. We assume that two neighbor sensors are connected if their 
Euclidean distance is less than r = \J (log m) Jm, which ensures graph connectivity with high probability lTT9l . 
We consider static network topologies, which means that the edge set does not change over the iterations. As an 
illustration, we consider the Metropolis and the Laplacian weight matrices ifTTl defined respectively as: 

• Metropolis weights 

l+max{d(i),d(j)} ' lf{2,j}e£ 

if*=j (18) 



W[i,j] 

, 0, otherwise, 

where d(i) denotes the degree of the i th sensor. 
• Laplacian weights 

W = I-aL (19) 

where L denotes the Laplacian matrix of the graph Q and the scalar a must satisfy < a < l/d max , where 
dmax consists of the maximum degree in the network. 
Moreover, the initial states of the sensors are uniformly distributed in the range [0, 1]. 
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(a) (b) 

Fig. 1. (a) Evolution of the fit values over the iterations, (b) Comparison of the average consensus performance of the Progressive Quantizer 
with parameters generated (i) recursively and (ii) with a linear model. 



A. Performance of the approximate exponential model 

We first validate the exponential model for St and we use the Metropolis weight matrix for this experiment. We 
compute recursively the values St from Eq.dTOl for 200 random realizations of a random network topology and 
communication rates of n = [2,4,6] bits. For implementation issues, we fix a parameter 5 = 10~ 16 . At iteration 
t, if the quantization range St is smaller than 6, we quantize with the range computed at the previous iteration 
i.e., we set St = St-i. All the reported experimental results are averaged over the 200 random realizations of the 
network topology. In order to compare directly with the proposed exponential model in Section [TlI-BL we plot the 
values fa that occur when we express the quantization range, computed from Eq.dTOl. as St = 2 • e~ /3t . We observe 



in Fig ] l(a)| that the value of (3 t appears to increase linearly with the number of iterations, which means that the 
quantization range follows an exponential function that decreases over time. Moreover, the slope of the function 
fit is independent of the bitrate, while the y-intercept value depends on the number of quantization bits. This is 
consistent with our approximate model (see Section IIII-Bb and Eqs. ([141 and (fl~6l ). which shows that the slope a is 
dependent on the convergence rate A2 (and hence the network topology) and that the parameter 7 is influenced by 
the communication rate. We further compare the performance of the Progressive Quantizer whose parameters are 
computed using the approximate linear model (from Eqs. (fT4l and ( fT6b ) with the performance achieved when St is 
computed recursively from Eq.dTOV Fig.( |l(b)| shows the obtained results. We observe that the performance is rather 
similar in both cases. This implies that the solutions of Eq.dTOb can be well approximated with an exponential model 
whose parameters are easily computed. For this reason, in the rest of our experiments we adopt the approximate 
exponential model and compute the parameters a and 7 of the Progressive Quantizer using Eqs. (fl~4l and ([Tol l. 



B. Comparison to uniform quantization 

We compare the proposed quantization scheme ('ProgQ') with a baseline uniform quantization with a constant 
range 5 = 1 ('UnifQ'), for both the Metropolis and the Laplacian weight matrices. Fig. [2] illustrates the average 
consensus performance corresponding to the absolute error \\z t — [il\\2 versus the number of iterations for n = 
[2, 4, 6] bits. In order to obtain statistically meaningful results we average the error over 200 random realizations 
of the network topology with random initial values. Observe that the performance of the proposed quantization 
scheme is very satisfactory even at a very low bit rate (2 bits). In particular, the error \\zt~ /il||2 shows a decreasing 
behavior over the iterations, which means that the quantizer does not saturate. It rather follows the evolution of the 
average consensus algorithm in the noiseless case ('no quant.'). On the other hand, the performance of the uniform 
quantizer with a constant range saturates quickly even at high bit rate. 
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Fig. 2. Average consensus performance of the proposed quantization scheme (ProgQ) vs uniform quantizer with a constant range (UnifQ) 
for 2, 4 and 6 bits. 
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Fig. 3. Average consensus performance of the proposed quantization scheme (ProgQ) vs the adaptive quantizer (AdaptQ) II 141 for 2, 4 and 
6 bits. 



C. Comparison to existing quantization schemes for average consensus 

We compare the proposed Progressive Quantizer ('ProgQ') with (a) the adaptive quantizer ('AdaptQ') [14], (b) 
the zoom in-zoom out uniform encoder ('ZoomQ') [15] and (c) the quantization scheme proposed in |[T6l ('Li 
et al.'). In particular, the scheme proposed in lTT4l is based on the Delta modulation with variable step-size. The 
step-size is adapted throughout the iterations based on the previously sent bits and a constant K. However, the 
scheme is quite sensitive to the value of K and the performance can deteriorate for non-carefully chosen values. 
In our experiments we choose K = 1.2 as defined in lfT4l . On the other hand, the differential encoding scheme 
proposed in |TT31 uses a uniform quantizer and the transmitted value is the quantized difference of the current value 
from the previous estimate, scaled by a factor / that is adapted over time. This factor is similar to the step-size 
of lfl4l and it grows or decreases depending on the difference between the new state Zt+i and the previously 
quantized state Zf. The decrease or the increase depends on the constants ki n and k ou t respectively and the way that 
these constants have to be determined seems to be an open question. In our experiments we choose the parameters 
ki n = 0.5, k ou t = 2 and the scaling factor /o = 0.5 as defined in ifTBTl . Finally, the scheme proposed in |[T6l is 
also designed by adapting the scaling function of a difference encoder similar to our quantizer. The value that is 
quantized at each time step is the difference between the new state zt+i and the previously quantized state z t while 
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Fig. 4. Average consensus performance of the proposed quantization scheme (ProgQ) vs the zoom-in, zoom-out uniform quantizer (ZoomQ) 
flfl for 2, 4 and 6 bits. 
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Fig. 5. Average consensus performance of the proposed quantization scheme (ProgQ) vs the quantization scheme proposed in 1161 (Li et 
al.) for 2, 4 and 6 bits. 



the scaling function is assumed to have an exponential decay over time. The parameters of the scaling function 
are defined in an interval form in such a way that the quantizer never saturates. However, one limitation of the 
scheme in |[T6l is that the algorithm is designed only for the Laplacian weights of the form W = I — aL, where 
the parameter a depends on the number of quantization bits. In order to directly compare the performance of the 
Progressive Quantizer with the quantization scheme of fTo"! . we implement the version of the latter scheme that 
corresponds to a fixed number of quantization levels (Algorithm 1 in |[T6l ). The parameters of the scaling function 
are representative values that belong to the proposed intervals. The edge weights of the matrix W are computed by 
Eqs. ( fT8l ) and (fT9l ) for the Progressive Quantizer, the adaptive quantizer and the zoom-in zoom-out quantizer while 
for the quantization scheme of |fT~6l they are computed as defined in the corresponding paper, as they depend on 
the selected parameters of the scaling function. 

We use the same experimental setup as in the previous experiments. Figs[3jl!l[5]illustrate the simulation results and 
show performance comparisons for the quantizers with different bit rates. Notice first that our scheme outperforms 
the three above mentioned schemes in all the cases. AdaptQ appears to saturate especially for a small number of 
bits. The performance of ZoomQ seems to be quite good for 4 and 6 bits, but it suffers significantly at low bit 
rate. On the other hand, the performance of the last scheme (Li et al.) is quite poor even for 6 bits. This result is 
quite expected since the proposed intervals for the parameters of the scaling function are too conservative; they are 
computed such that no clipping appears during the iterative consensus algorithm. Moreover, we observe that both 
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the selection of the weight matrix as indicated in IU6I and its dependence on the bit rate penalize even more the 
convergence rate and the overall performance of the consensus algorithm. 

Our scheme bear some resemblance with these three schemes in the sense that we also propose to adapt a scaling 
function. The scaling function has a very specific definition in our case where it represents the sensors' dynamic 
range. Moreover, we impose a consistent decay of the quantizer range size which is intuitively supported by the 
increasing correlation of the sensors' states throughout the iterations. The parameters a and 7 that determine the 
quantization range in our Progressive Quantizer have been carefully designed by taking into consideration both the 
available number of bits and the topology of the network and they are automatically determined in closed-form 
from Eqs. ([T4l ) and (fT6l ). Finally, the performance comparison with the scheme proposed in lfl6l confirms our initial 
intuition that very conservative bounds do not necessarily improve the average consensus performance, and that 
average case analysis is more efficient in practical settings. 



D. Convergence of the consensus algorithm 

The assumption that the quantizer saturates complicates significantly the convergence analysis of the proposed 
algorithm. Our Progressive Quantizer may generate some clipping of the values computed by sensors. We have 
shown through extensive experimental results that this clipping does not significantly penalize the convergence of 
the consensus algorithm. It can even help in case of strong outliers. Moreover, we have observed that the number 
of clipping, if any, is small and decays to zero as the iteration of the consensus algorithm increases, as long as the 
parameter 7 is computed according to Eq.(fT6l). However, clipping results into some important non-linear effects 
that are difficult to analyze. In this subsection, we give some intuition about the convergence properties as well as 
the convergence speed of the Progressive Quantizer. The simulation results provided in the previous subsections 
verify that the proposed scheme leads the sensors to converge to the average of their initial values. We notice first 
that the quantization range reduces to zero as time elapses, leading to an accurate average consensus that is reached 



independently of the number of bits. The latter is verified experimentally in Fig ]6(a)[ where we observe that, as the 
range reduces to zero, the absolute error from the accurate consensus value p becomes smaller. 

Moreover, the design of the Progressive Quantizer promotes the decrease of the quantization noise variance over 
time. By properly decreasing the quantization range, we reduce the quantization noise, as long as the computed 
values to be quantized fall into that range. We finally relate the convergence of the algorithm to the quantization 
noise in the following proposition. Similar results have been shown in ifTTll . 

Proposition 4. Let cr| be the sample variance of the quantization noise vector et at iteration t. If o~\ — >■ as 
t — > 00, the sensor nodes converge asymptotically to the true consensus value p. 

The proof of Proposition |4] is given in Appendix |Pl 

Fig j6(b)| verifies that our scheme leads to a quantization noise variance that converges to zero as time elapses 
with exactly the same behavior as the quantization range. These results are consistent with the ones shown in Fig. 
121 It confirms that the average consensus performance is directly related to the decay of the quantization noise 
variance and that an accurate consensus is achieved for a variance that converges to zero. Finally, the decay of the 
noise variance and thus the convergence speed depend on the number of the quantization bits; more precisely the 
algorithm converges faster for a large number of bits, which is expected. 



V. Conclusions 

In this paper, we have proposed a novel quantization scheme for solving the average consensus problem when 
sensors exchange quantized state information. In particular, our scheme is based on progressive reduction of the 
range of a uniform quantizer. It leads to progressive refinement of the information exchanged by the sensors while 
the average consensus algorithm converges. Simulation results show the effectiveness of our scheme that outperforms 
other quantized consensus algorithms in terms of convergence rate and accuracy of the computed average. Finally, 
our quantizer represents a constructive simple solution with effective performance in realistic settings. 
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Fig. 6. (a) Evolution of the average consensus performance for an exponentially reducing quantization range, (b) Evolution of the variance 
of the quantization noise over the iterations for 2, 4 and 6 bits. 

Appendix A 
Proof of Proposition Q] 

Eq. dU) implies that 

t-i 

zt+i -zt = W\W - I)z + (W- 2I)e t + {W-I)Y,W S (W- I)e t - a -i. (20) 



s=0 



Let us define 



and 



Ai := W\W - I)z 



t-i 



A 2 := (W-I)J2 WS ( W ~ fyt-s-l + {W- 2I)e t . 



Then, we observe that 



E[\\z t+ i - z t \\ 2 } = EIWA4 2 } + E[AjA 2 ] + E[A T 2 A{\ + E[\\A 2 \ 



(21) 



In the formula above, ||^4i|| 2 is a deterministic quantity depending on the (fixed) network topology and the initial 
states of the sensors. We assume that the quantization noise samples e t {i) in © are (spatially and temporally) 
independent random variables that are uniformly distributed with zero mean and variance Af/12, where A t is the 
quantization step-size at step t. The latter assumption is widely used in the literature ||9], ifTTll . Ifl4l for modeling 
the quantization noise and is true under the conditions specified in EOl . Due to this independence assumption, the 
two cross terms .Ef-Aj"^] and E[A]~Ai] become zero, and (1211 simplifies to 



E[\\z t+1 -z t \\ 2 ] = \\A 1 \\ 2 + E[\\A 2 \\ 2 

In the sequel, we work out each individual term separately. First, note that 

PxfHIW^W-I^oll 2 
\\W\W -I)z Q 



(22) 



■{W-I)z \\< 



(23) 



(6) 
< 



w 



11 1 



\w-ifuw 



12 



where (a) follows from the fact that W is doubly stochastic and (b) holds because 
A 2 := p(W - ^-). Moreover, 



W* 



ill 

m 



\\, where 



E[\\A 2 \\ 2 ] = E[\\(W W \ W ~ I>t-s-i + {W- 2I)e t \\ 2 ] 

t-1 

<\\W- I\\ 2 Y, \\W S (W - I)\\ 2 E[\\e^ s ^\\ 2 } + \\W- 2I\\ 2 E[\\e t \ 



where we have again exploited the fact that the quantization noise variables are independent and zero mean. 
We compute the expectation of the quantization error norms by exploiting the consistently reduced range of the 
Progressive Quantizer. In particular, the expectation of the error norm at each time step t can be expressed as 
S[||et|| 2 ] < mE[et(i) 2 ] < mA 2 /12 (20l , where At is the quantization step-size at step t. Hence, the expectation 
of the second term is bounded as follows 

t-i 



E[\\A 2 \\ 2 ] < \\W - I\\ 2 Y,W S {W - I)\\ 2 m^ 2t ~ s ^ 



s=0 



12 



\W - 2I\\ 2 m- 



12 



(24) 



We finally derive an upper-bound for i?[||z t+ i — z t \\ ] by combining both (1231 ) and (1241 ) and taking into consideration 
that A 2 = (|^) (see also Eq. ©). Altogether, we obtain 



E[\\z t+ i - z t \\ 2 } < ||zo|| 2 Ari|^ -I\\ 2 + \\W - If £ \\W S (W I)| 



q2 

2 °t- 



s=0 



J 2 2 ™ • 12 



\W-2lVm- 



S? 



2 2n ■ 12' 



Since the eigenvalues of the matrix W lie in the interval [—1,1], the Proposition Q] follows from the fact that 
\\W — I\\ = 1 — A m i n and \\W — 2I\\ = 2 — A m i n , where A m j n is the smallest algebraically eigenvalue of W . □ 

Appendix B 
Proof of Proposition [2] 

Firstly, we define a new sequence P(t) to be the upper-bound of e -2 ' 3 *. 
Definition 1. The sequence P(t) is defined as: 



(4 



(max) (min) \ 2 



P(0) = 



P(1) = ||Z ||L(1-A mi n) 2 + 



(2 A m j n ) 2 
2 2n ■ 3 



P(0) 



s2,2(*-l) , , ^^2sP(t-2-s) , , n x s2 P(t-l) 



P(t) = ||z ||^(l - A min ) 2 Af " 1} + (1 - A min ) 4 J2 X 



s=0 



2s; 

2 2 2n • 3 



+ (2 — A m i n )^ 



2 2 ™ • 3 



t > 2. 



Moreover, 



P(0) = e- 2l3a 



t > 2. 



P(l) = e- 2 ^ 
P{t) > e- 2fit 

We can then write the sequence in the following form 

P(t + 1) = (c + 7 )P(t) + (b - cj)P(t - 1), 

where c ~ ~ ^ 2 



(25) 



^2^3^ ' ^ = ~ 2^3^ anc * T = ^2 are positive constants. Expressing the above sequence in a matrix 
form we obtain 



p(t + l) 




c + 7 b — cy 




' P(t) 


P(t) 




1 




P(i-l). 



(26) 
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The eigenvalues of the matrix A are c+7± 'v / ^ 7 ) +4b anc [ the dynamical system (|26l ) converges to zero if its 
eigenvalues are strictly smaller than 1 [21 ]. Since c, b and 7 are three positive constants, it is enough to find 

conditions that guarantee that ^ — < 1. After substitution of the values of the constants c, b and 7, it 

leads to the following inequality 



(2 A min ) 2 2 // (j A m j n ) 2 \2\2 1 A (-*- ^min) 4 ^ q 

3-2 2 « +A 2 + V ( 3-22" +4 3-22" <2 ' 

Equivalently, we can write 

4(1 ' Amin)4 ' 3 4(A j r : 1)(2 ' Amin)2 < ( 2A 2 - 2) 2 - 2A 2 (2A 2 - 2), (27) 
which indicates that P(t) converges to zero if the following condition 

(1 — A m j n ) 4 



(1-AI) 



+ (2 - A min )^ < 3 • 2 Zn (28) 



is satisfied. Since the sequence P(t) is an upper-bound of the positive sequence e 2/3t , if the condition (|28l ) is 
satisfied, e -2 ^* also converges to zero. □ 

Appendix C 
Proof of Proposition [3] 

Recall from (|23]> that ||Vy*(Vy-/)|| 2 < \\W - ^\\ 2t \\W - 1\\ 2 = \f(\ - A min ) 2 . Moreover, under the condition 
specified in Proposition |2j we have that lim^oo e - ^* = 0. Given e > 0, there exists a time instant k > such that 

\ft > k, e _ft < e. Then, 

]T \\W S (W - I)\\ 2 e- 2 ^— 1 < ^ ||W - — \\ 2s \\W - I\\ 2 e- 2 ^-^ 

s=0 s=0 ™ (29) 

= ||W - I|| 2 V \\W - — || 2 'e- a *— 

Moreover, since the eigenvalues of the matrix W lie in the interval [—1, 1] we have that \\W — I\\ = 1 — A m i n < 2. 
Hence, using these observations and setting I = t — s — 1, the above inequality can be written as 

Y \\W S (W - J)|| 2 e- 2A — 1 < 4V IIW- H^|j2(*-/-D e -2A 

Z — ' ^-^ TO 

ft T t-1 T ^ 

<4 V \\ W - —W^- 1 - 1 ^- 2 ^ +4 V H^-'-^e 2 . 
^ — ' m ^ — ' m 

We notice that, since II W — ^-\\ < 1, e~P* < 5, Vt and /c is finite, the first term of the right-hand side of the 

' II m II ' — 1 ' o 

inequality converges to for t — > 00. Finally, we can write 

Km Y \\W S (W - I)\\ 2 e- 2 ^-^ < lim 4 V II W - — ll 2 ^" 1 ^ 2 

^sTo m (31) 



< lim 4Ce 2 0, for e 0, 

t— >oo 



where we have used the fact that lim^oo Y^i=k+i \\W — ^~\\ 2<yt 1 ^ converges to a constant C < 00. 

□ 
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Appendix D 
Proof of Propositions] 

The proof of Proposition |4] is similar to the one of Proposition [3] Assume that the sample variance of of the 
quantization noise components converges to zero after some specific iterations. In particular, given 5 > 0, there 
exists a time instant k > such that Vr. > k, al < 5. Using Eq.©, the Euclidean deviation of the node states can 
be expressed as 



11 T „ „„^ 1 ^ . H T 



\z t+ i z \\ = \\W t+1 z + V W S (W - T)e t . 

m — ^ 



m ' to 

s=0 

< \\W t+1 z Zo\\ + V \\W S (W - 7)e t _ 6 

to ^— ' 

s=0 

11 T „^ 1 „ 11 T „ 



< IIW 



Fo -sol 



E II - — W - I)(e t . s - —e t . s )\\ 



m 

s=0 

11 T 11 T 

<\\W-— || t+1 ||z -— zo\ 



.j2\\W-—nW-I\\\\e t - a 



m m 

s=0 



where we have used again the properties of the matrix W as defined in Eq. (UJ. Notice that [| e t s — ^^et_ s || can be 



m 

written in terms of the sample variance of_ s of the quantization noise at iteration t — s such as ||et_ s — ^-et- s \ 



'maf_ s . Moreover, using the fact that \\W — I\\ = 1 — A m i n < 2 and setting I = t — s, the above inequality can 
be written as 



\zt+i 



rj~\ rj~\ rji £ rj~i 

— zo\\ < \\W-—\\ t+1 \\z Q -—z \\+2V^Y,\\ W -—\ 
m mm '■ — ' m 



t-l 



\w - — n t+i iiz - — *oii + 2v^(E \\w- — \r\io 

m m L — ' m 

1=0 

11 T 



E 11^-— iryof) 



m 

l=k+l 

We notice that since \\W — ^—\\ < 1 and k is finite, the first two terms of the right-hand side of the inequality 
converge to for t — > oo. Furthermore, by assumption we have that al < 5, Vi > k, which implies that for t — > oo, 
we have 

lim \\z t +i zq\\ < 2Vm<5 lim V II W 1 1 * * < 2^/mSC, 

t->oo m t->oo * — ' to 

/=fc+i 

where again we have used the fact that lim^oo Y^l=k+i II W ~~ ^rll'"' converges to a constant C < oo. Finally, 
as the variance converges to 0, the sensors reach a consensus on the average fj, = -^-zq i.e., 

11 T 

lim ||z t+ i 2o 1 1 ->• for 5 -> 0. 

t-S-oo to 

□ 
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